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METHOD FOR UTILIZING USER INPUT FOR FEATURE DETECTION IN 
DIAGNOSTIC IMAGING 

The present invention relates to ultrasound diagnostic imaging. Specifically, the 
present invention relates to a method for utilizing user input for feature detection in 
5 diagnostic imaging. 

Ultrasound has become an important tool in medical diagnostics. Ultrasound's non- 
invasive and generally benign radiation-firee imaging has found wide spread use, especially 
in fetal imaging and extended exposure video imaging. While ultrasound has good 
penetration through the soft tissues of the human body, there is no way to prevent 
10 reflection of overlaying stmctures from obscuring the areas of interest during the imagmg 
process. This becomes particularly unportant for 3D or Live 3D ultrasound imagmg where 
the relationship of the overlying structures may have a complex relationship with the 
viewing planes or volume being observed 

Attempts have been made to provide a way to remove obscuring or distracting 
1 5 regions from ultrasound images and volumes. One such method requires the operator to 

manually select and remove the obscuring region within an xiltrasound imaging application. 
While this method provides adequate accuracy, it is a very time consuming process and 
thus not appropriate for real-time ultrasound imaging applications. 

A second method provides an automatic selection process wherein the operator 
20 initially identifies the region of interest, perhaps by selecting from a menu of choices or 
manually selecting the region, and from that point on the ultrasound imaging software 
automatically detects and removes or de-emphasizes the obscxiring portions of the 
ultrasound image. This method can be significantly faster and therefore has the potential of 
being very usefiil in real-time applications. However, this method too has its drawbacks. 
25 While corporeal structures have the same basic shape from one person to another, size may 
differ, disease may alter the shape of the structure, and even the particular position of the 
ultrasound transducer during imaging may cause the structure to appear altered from its 
typically accepted shape. These variations in shape can lead to misidentification of regions 
by the automatic selection process. This possibility for misidentification also contributes to 
30 an operator's rehictance to rely on the automatic selection process, defeating the purpose of 
si5)plying such a process in the ultrasound imaging software. 
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What is needed is a selection process that is both accurate enough to inspire trust 
from the operator and fast enough to be applicable in real-time imaging applications. An 
object of the present invmtion is to provide a method tha^ with limited input from the 
operator, is able to identify regions of interest in an ultrasound image or volume, both still 

5 and live, and remove or de-en5)hasize obstructions thereon. 

The present invention provides a method for utilizing user input for segmentation 
and feature detection in diagnostic imaging. By using the detection methodology of the 
present invention, structures can be identified and either emphasized or de-en9>hasized 
based on their position within an operator-specified region of interest 

10 The method of the present invention for defining internal stmctural borders in a 

medical ultrasonic image includes several steps. Initially, an ultrasonic image or volume 
region having a region of interest is acquired. A feature of interest is located in the 
ultrasonic image or a plane of the volume and at least one side of the shape is placed in a 
proximal relationship to the feature. At least one starting point within at least one shape is 

15 identified. The starting point is used for detecting and delineating a tissue border within the 
ultrasonic image or tissue surface within the volume. The tissue border detection is 
performed using internally stored complex shapes having fuzzy border regions instead of 
solid linear borders. As more points are located, the border regions may be adjusted to 
produce a best-fit based on the currently located points. An indicator is provided for 

20 identifying and highlighting the tissue border on the ultrasound image to the operator. The 
indicator may include emphasizing the tissue structure by colorizing or enhancing the 
contrast of the region bounded by the detected tissue structure. 

Additionally, the present invention may allow the operator to interactively modify 
the shape placed in proximal relationship to a feature. The operator modifies the shape so 

25 that it more close matches or approximates the region of interest, i.e. if the region of 
interest is generally oval or ellipsoidal in shape, then the operator may select a circular 
shape, place the shape over the region of interest, and deform the circular shape to obtain 
an oval of approximately similar dimensions as the region of interest. 

The foregoing objects and advantages of the present invention may be more readily 

30 understood by one skilled in the art with reference being had to the following detailed 

description of preferred embodiments thereof, taken in conjunction with the accompanying 
drawings in which: 
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FIG. 1 is a flowchart iUustrating the steps performed by the method for utilizing 
user input for border detection in diagnostic imaging in accordance with the present 
invention; and 

FIG. 2 is a block illustration of a system for border detection in diagnostic imaging 
5 in accordance with the present invention. 

Several embodiments of the present invention are hereby disclosed in the 
accompanying description in conjunction with the jSgures. Preferred embodiments of the 
present invention will now be described in detail with reference to the figures wherein like 
reference nimierals identify similar or identical clients. 

10 An embodiment of the present invention, shown in FIG. 1, provides a method for 

defining internal structural borders in a medical ultrasound image. In step 101, an 
ultrasound imaging system images a patient or other object appropriately capable of being 
imaged by ultrasound energy. The ultrasound imaging system transfers the ultrasound 
image(s) or volume data to an electronic data storage device, e.g. volatile and non- volatile 

15 memory, magnetic media, optical media, etc. in step 102. The image data is also displayed 
on a display screen having an interface configured for providing an operator controllable 
image processing and analysis functionality in step 103. 

In step 104, an operator selects one or more region(s) of interest (Rol) on the 
displayed image data as the desired starting point (seed). The interface allows the operator 

20 to indicate tibie Rol (either in 2D or 3D) by selecting one or more shapes from amongst a 
variety of simple geometric models, e.g. circle, square, polygon, slice, cube, sphere, etc., 
and placing the selected model on the image so that the model bounds the Rol. 
Additionally the interface provides a method for the operator to indicate the ultrasound 
image type, for example, cardiac, fetal, etc. 

25 The image type and bounded Rol are used by the system for analyzing the area 

within the region(s) of interest in step 105. Contours and structures within the Rol are 
detected in step 106. A method for delineating these contours and stmctures includes 
adjusting contrast and colorizing stmctures according to predefined or operator-definable 
preferences, and display of the resulting image data on the display screen are provided in 

30 step 108. The delineation preferences to be applied to the Rol of the ultrasound image are 
set in step 107 prior to execution of step 108. 
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In step 109, the operator is given the opportunity to review and either accept the 
image processing as displayed in step 108 or reject it if the Rol is not acceptably displayed. 
If the results of st^ 108 are acceptable, the process is con5>leted. However, if the operator 
rejects the results of step 108, step 104 is executed again, giving the operator an 
5 opportunity to adjust the Rol selection as well as the image type in an attempt to refine the 
resulting image data in step 108. The subsequent steps are executed as described above. 

Additional features may be incorporated into the present embodiment of the 
invention, for sample, the method may include a process by which the system can learn • 
and adapt over time based on the feedback received from the operator in step 109. Fxurflier, 

10 image processing and manipulation functions may also be provided by the system, such as 
enlarging, rotating, and cropping the Rol. 

The analysis and detection steps are performed by the present embodiment through 
analytical algorithms, which use predetermined and internally located complex shapes 
approximating the general shapes of various bodily tissues and structures. The indicated . 

15 image type is used to identify which of the variety of complex shapes are to be applied to. 
the Rol analysis. However, as discussed previously the imaged shape of a bodily tissue or 
structure may appear different from the typically associated shape of the tissues and 
structure due to various factors such as the angle and position of the ultrasound imaging 
unit. For this reason, the present embodiment utilizes a fuzzy model of these tissues and 

20 structures. In this case fuzzy is meant to indicate that the complex shapes have, as their . 
boundaries, a predefined acceptable range (e.g., maximal size limit) instead of a sharply • 
defined boundary, thus a tissue boimdary point need not lie directly on the boimdary of the 
corresponding complex shape but merely within the acceptable range. Additionally, as 
more of the tissue boundary points are detected on the image, the acceptable range of the 

25 boundary of the complex shape may be adjusted as appropriate, "on the fly*' or in real-time, 
based on the location of the detected points. These detections and adjustments are 
performed automatically by the pi e sent embodimen t 

An alternate embodiment of the present invention allows the operator to adjust a 
shape selected from the variety of simple geometric models following the execution of step 

3d 104. Thus, the shape used to indicate the Rol can more closely match the actual shape of 
the region and, consequently, increase the accuracy and speed of the analyzing and 
detection steps. Additionally, if in step 109, the results from step 108 are rejected, then the 



wo 2005/048194 



PCT/IB2004/052431 



originally selected shape of step 104 can be modified to increase the likelihood of a 
successful end result from step 108. 

The method as described above may be implemented as a software application or 
set of processor commands and installable onto a pre-existing ultrasound diagnostic 
5 system. La this embodiment, the software application may be stored on any of variety of 
commonly used con^uter readable media, such as compact disc, DVD, and magnetic 
media, or as a network downloadable software package. 

Another embodiment, as shown in FIG. 2, provides an tdtrasound diagnostic system 
200 conjBgured and disposed for executing the steps of the present invention as described 

10 above. The system 200 includes a controller/processor unit 201, having a user input 

device(s) 202, such as keyboard, mouse, speech recognition device, etc., a storage device 
203, and a display screen 204, connected with and configured for controlling an ultrasound 
imaging device 206, such as an ultrasonic probe. An optional, hard copy output device 205, 
such as a printer, may also be present and connected to the controller/processor unit 201 . 

15 A software application or set of processor commands, residing within Ihe 

controller/processor unit 201 or stored on the storage device 203, is configured to ex:ecute 
the steps of the method of the present invention as shown in FIG. 1 and described above. . 
The controller/processor unit 201, upon receiving an actuation signal fi-om the operator via 
the user input device(s) 202, activates the ultrasoimd imaging device 206. The actuation » 

20 signal may include or be preceded by a set of operator-adjustable preference signals which 
are used by the controller/processor unit 201 to adjust the parameters of the ultrasound 
imaging device 206. The ultrasoimd imaging device 206 transmits high frequency audio 
signals toward a patient or object (not shown) to be imaged and receives signals reflected 
from structures internal to the scanned patient or object in a manner well known in the art. 

25 The received signals are transferred to the controller/processor unit 201 for further 
processing. 

The controller/processor unit 201 processes signals and displays a corresponding 
image 208 on Ihe display screen 204. Additionally, the controller/processor unit 201 
provides an interface, preferably a graphical user interface (GUI) 207, which allows the 
30 operator to selectively indicate a region of interest (Rol) on the displayed image 208. The 
inter&ce may consist of any of a combination of interface elements, such as menus 209, 
buttons 210 and icons (not shown) configured to provide predetermined functions. The 
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operator selects the Rol by selecting one or more shape(s) from a variety of simple 
geometric shapes- square, slice, circle, cube, sphere, etc. — provided by the interface 207 
and positioning the shape(s), orientation and size over the Rol such that the Rol is bounded 
approximately to the boimdaries of the shape(s). Further, the operator indicates the type of 
S ultrasound image being displayed through manipulation of interface elements 209, 210, etc. 
Based on these few inputs from the operator, the controller/processor unit 201 applies 
predeiBned algoritimis to the Rol for enhancing the various structures contained within the 
Rol. 

The described embodiments of the present invention are intended to be illustrative 
10 rather than restrictive, and are not intended to represent every embodiment of the present 
invention. Various modifications and variations can be made without departing from the 
spirit or scope of the invention as set forth in the following claims both literally and in 
equivalents recognized in law. 



